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(54) Method and apparatus for reordering components of computer programs 



(57) A method and system for reordering sections 
of a computer program are disclosed. The computer 
program is executed during an experimental execution 
period. During the execution period, an access record 
is made. The access record identifies when each sec- 
tion of the computer program is accessed. After the ex- 
ecution period, the sections are reordered based on 
when the sections were accessed during the execution 
period. The sections may be code sections, data sec- 
tions, or a sections that contain a combinatin of code 
and data (e.g. objects). According toone disclosed tech- 
nique, the execution period is divided into time intervals. 
Each time interval corresponds to the time period in 
which a discrete high level operation of the computer 
program was performed. A data matrix is created where 
each row corresponds to a section, and each column 
corresponds to a time interval. Values are stored in each 
ceil of the data matrix based on whether the correspond- 
ing section was accessed during the corresponding time 
interval. The sections are then reordered based on the 
values in the rows to which they correspond. 
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Description 

FIELD OF THE INVENTION 

The present invention relates to software develop- 
ment, and more specifically, to a method and apparatus 
for ordering code sections of a* computer program for 
efficient execution in a virtual memory environment. 

BACKGROUND OF THE INVENTION 

- Numerous types of computer programs exist, in- 
cluding. application programs, device drivers, libraries, 
etc:. For the.purposes of. discussion, all such types of 
computer programs shall be referred to herein by the 
general term "computer program". Regardless. of the 
program type, all -computer programs include instruc- 
tions, which, when executed, by a processor, cause the 
processor to perform certain functions. When a compu- 
ter program is not being executed, the digital data that 
v represent the instructions (the "instruction data image") 
- are typically stored on a relatively slow non-volatile stor- 
,v - age device, such as a magnetic or optical disk. The slow 
- > speed of the storage would create a substantial bottle- 
neck if the instructions were read directly from jhe stor- 
age during execution of the computer program. - >- 

- ; : To avoid such .abottleneck, the instruction data im- 
agers typically copied into a relatively fast volatile stor- 
.;-« - age, such as random access memory, prior to execution 
of the program. The processor reads the instructions di- 
rectly from the copy of the instruction data image that is 
* f . - contained in the faster storage, thereby avoiding the 
need to constantly access the slower storage. 

v As the functions performed by computers become 
more complex, the size of the instruction data image in- 
. creases. Consequently, the amount of fast memory re- 
quired to store an entire copy of the instruction data im- 
age during program execution also increases. Because 
fast memory, is relatively expensive, techniques have 
been developed for reducing the amount of fast memory 
required to efficiently execute a program. 

According to one technique, a portion of the slower 
storage is combined with the faster storage to provide 
a "virtual memory" that is larger than the available 
amount of fast storage. During execution of a program, 
the instruction data image of the program is stored in 
the virtual memory. Typically, this means that at any giv- 
en time, some portions of the instruction data bridge are 
stored in the slow storage while other portions of the 
instruction data image are stored in the fast storage. The 
( portions of the instruction data image that are stored in 
the fast storage are referred to herein as the "loaded 
, : portion" of the computer program. To avoid wasting fast 
. ■ storage, it is preferable to limit the loaded portion of a 
. .. r. computer program to only those portions of the instruc- 
'v<" tion data image that are. required to perform the current 
'..j high-level operation. . 

Typically, instructions must, be loaded into the fast 



storage before they can be executed. Therefore, prior 
to executing an instruction, the portion of the instruction 
data image that represents the instruction must be part 
of the loaded portion. If the instruction data image that 

5 represents the. instruction is not already stored in the 
fast storage, then it is copied from the slow storage into 
the fast storage. If there is not enough unused space in 
the fast storage, then a portion of the fast .storage, must 
be freed to receivelhe required instruction data image. 

1Q The.process of freeing up a portion of fast storage may 
involve copying modified data from the last storage to 
the slow storage. Each time data is transferred between 
the slow storage and the fast storage,; the execution of 
the computer program is delayed., ; , • 

ts . Techniques have' been developed to minimize the 

: number of data transfers that take place between the 
slow and fast portions of virtual memory. Specifically, it 
- has been recognized that instructions that cause a proc- 

. essor to perform low-level operations are typically locat- 

20 ed near each other in the instruction data image . Thus, 
when one ' instruction is executed, it is likely that other 
instructions in the vicinity of the instruction will have to 
be executed in the near f uture. Consequently, most vir- 
tual memory systems move instructions between the 

2S slow and fast storage portions of virtual memory on a 
block; by block basis, rather than instruction by instruc- 
tion*. •< • i-'.r." 

By forcing the instructions that correspond to higher 
level operations to be grouped together in- the same 

30 code block, both the number of data transfers between 
the slow and fast portions of virtual memory and the size 
. of the loaded portion may be reduced. For example, 
consider a discrete high level operation O that requires 
the execution of functions^; Y and Z. If the instructions 

35 to perform functions X, Y and 2 are located in the same 
code block, then the minimum loaded portion would con- 
sist of a single block. In addition, a maximum of one code 
block transfer would take place prior to the performance 
of operation O. However, if the instruction sequences to 

40 perform functions X, Y and Z were each stored in sep- 
arate code blocks, then the minimum loaded portion dur- 
' ; ing the performance of operation O would include three 
blocks. In addition, up to three code block transfers may 
be required to load the loaded portion. Even more code 

45 block transfers, may be required if the instructions for 
; function X are distributed among many code blocks, the 
instructions for function Y:are distributed among many 
code blocks, and the instructions for function Z are dis- 
tributed among many code blocks. 

so - . Based on the. foregoing, it is desirable to provide a 
method and apparatus for reducing the size of the min- 
imum loaded portion. Further, it is desirable to provide 
a method for reducing the number of code block trans- 
fers that are performed during the execution of a com- 

55 puter program in a virtual memory environment. It is fur- 
ther desirable to provide a method and apparatus for 
j- organizing sections of the instruction data image of a 

. computer program into groups that have a relatively high 
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correlation to discrete,- high level operations. 
SUMMARY OF THE INVENTION 

A method and system ton reordering code sections 
ol a computer program areprovided. The computer pro- 
gram is executed during an experimental execution pen- 
od. During the execution period, an access record is 
made. The access record indicates when each code 
section is accessed. After the execution period, the code 
sections are reordered based' on when the code sec- 
tions were accessed' during the execution period. 

According to one aspect of the invention, the exe- 
cution period is divided into time intervals. Each time 
interval corresponds to the time period in which a dis- 
crete high level operation otthe computer program was 
performed. An access matrix is created where each row 

- corresponds to a code section, and each column corre- 
sponds to a time interval. Values are stored in each cell 
of the data matrix based on whether the corresponding 
code section was accessed during the corresponding 
time -'interval. The code sections are then reordered 
based; on the values- in the rows to which they corre- 
spond'/ ■ 

According to another aspect of the invention, each 
cell in the access matrix stores a single bit. Consequent- 
ly, each code section has a corresponding bit array. 
Code sections. may be reordered based on 1 the numeri- 
cal order of the number represented by their corre- 
sponding bit arrays. Alternatively, code sections may be 
reordered so as* to allow the least degree of deviation 
between the bit arrays of successive code sections. 

BRIEF DESCRIPTION OF THE DRAWINGS 

l : '■■ The present invention is illustrated by way of exam- 
ple, and, not by way of limitation, in the figures of the 
accompanying drawings and in which like reference nu- 
merals^efer to similar elements and in which: 

Figure-1 is a block diagram of a computer system 
upon which the present invention may be imple- 
mented; . * ' • • .•':>.. 
Figure 2 illustrates the various coda sections of an 
; exemplary computer program; 

- w Figure 3 shows a timeline that illustrates when the 
. ; various code sections of nhe computer program il- 
« . * lustrated in Figure 2 i we re accessed, during an exe- 
cution period; -v; * ■; . C**:' ■ 

v • ■ ( Figure 4 illustrates an access matrix- that has been 
constructed based on the accesses recorded dur- 
ing the execution period shown in Figure 2; . 
Figure 5. illustrates a new instruction data' image in 
which the code sections of „the: computer program 
illustrated in Figure 2 have been reordered accord- 

- r ing to an embodiment of the invention; and % 
■ : Figure 6 illustrates a new instruction data image in 
which the code sections of the computer program 



illustrated in Figure 2 have been reordered accord- 
ing to an embodiment of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
s EMBODIMENT • 

' A method and apparatus for ordering code sections 
in a computer program is described. In the following de- 
scription, for the purposes of explanation, numerous 
to specific details are: set forth in order to provide a thor- 
ough understanding of the present invention. It will be 
apparent, however, that the present invention may be 
practiced without these specific details. In other instanc- 
es, well-known structures and devices are shown in 
is block diagram form in order to avoidurinecessarily ob- 
•■'*''* scuring the present invention v " ~ 

> * Referring to Figure T, <the computer system upon 
which the preferred embodiment of the present inven- 
tion can be implemented is shown "as '100? Computer 
20 system 100 J comprises a bus or other; communication 
- means 10T for communicating information, ,and a 
' processing means 1 02- 'coupled with ! bus '■ 101 for 
■ : ' processing information. !■ System 1 00 further comprises 
a random access memory (RAM) or other dynamic stor- 
es ■ c age device 104 (referred to -as main -memory), coupled 
to bus T01 for storing information and instructions to be 
executed by processor 1 02> Main memory 1 04 also may 
1 . be used for storing temporary variables* or otheNnter- 

- p. mediate information during execution of instructions by 
30 processor 1 02. Computer system 1 00 also comprises a 

read only memory (ROM) and/or other static storage de- 
vice 1 06 coupled to bus 1 01 for storing static information 
and instructions for processor 102. Data storage device 
^ .107 is coupled to bus 101 for storing information and 
35 instructions. ' - r 

.-~ A data storage device 1 07 such as a magnetic disk 
or optical disk arid its corresponding disk drive can be 
coupled to computer system 1 00; Computer system 1 00 

- . can also be coupled via bus 101 to a display device 121, 
40 such as a cathode ray tube (CRT), for displaying infor- 
mation to a computer user. An alphanumeric input de- 

. vice 122, including alphanurheric and other keys, is typ- 
ically coupled to bus 1 01 for communicating information 
and command selections to processor 102. Another 

45 type of user input device is cursor control 123, such as 
a mousera. trackball; or cursor direction keys for com- 
municating direction information and command selec- 
tions to processor 102 and for controlling cursor move- 
ment on display 1 21 . This input device typically has two 

so degrees of freedom in two axes, a first axis (e.g., x) and 
a second-axis (e.g., y), which allows the device to spec- 
\ rfy positions in a plane. ' < : ' . 

x: Alternatively; other input devices such as a stylus 
or pen can be used to interact with the display. A dis- 

55 played object on a computer screen can be selected by 
using a stylus or pen to touch the displayed object. The 
computer detects the selection by implementing a touch 
sensitive screen. Similarly, a light pen and a light sensi- 



3 



RNfinonil"): <FP 07S5003A2 I > 



5 



EP 0 755 003 A2 



6 



tive screen can be used for selecting a displayed object. 
Such devices may thus detect selection position and the 
selection as a single operation instead of the "point and 
click, ° as in a system incorporating a mouse or trackball. 
Stylus and pen based input devices as well as touch and 
light sensitive screens are well known in the art. Such a 
system may also lack a keyboard such as 122' wherein 
all interface is provided via the stylus as a writing instru- 
ment (like a pen) arid the written text is interpreted using 
optical character recognition (OCR) techniques. 

According to an embodiment of the present inven- 
tion, computer system 100 is configured to determine 
an order for code sections of a computer program. The 
order causes code' sections that implement high-level 
operations to be grouped together Consequently, the 
number of blocks' in the minimum' loaded portion is re- 
duced: In addition, the amount of code block transfers 
that -occur when the computer program is executed in a 
system' with virtual memory is reduced. 

; - Referring to Figure 2; it illustrates the instruction da- 
ta image f 200 of an exemplary computer program P. 
When the computer program P is hot being executed, 
the instruction data image 200 is typically stored on slow 
storage, such as disk 1 07. When the "computer program 
P is executed; some or all of the instruction data image 
200 is loaded into a fast storage, such as memory 1 04. 

Instruction data image 200 contains code sections 
-202, 204,' 206, 208, 210, 212, 214 and 216. For the pur- 
poses of explanation, it shall be assumed that" code sec- 
tions 202, 204, 206, 208, 210, 212, 214 and 216 imple- 
ment functions F1, F2, F3, F4, F5, F6, F7 and F8 re- 
spectively. It shall also' be assumed that the computer 
program P performs three discrete high level opera- 
tions: OP1 , OP2 and OP3. As used herein, the term "dis- 
crete operation" refers to an operation which, once in- 
voked, carries through tocompletion unless interrupted. 
These operations may- be, for example, a program ini- 
tialization operation, a calculation operation and a pro- 
gram termination^ operation. It shall also be assumed 
that operation OP1 requires the performance of func- 
tions F2, F3 and FSV operation OP2 requires the per- 
formance of functions F2 and F4- and operation OP3 
requires the performance of functions F1, F2, F5 and 
F7. In this scenario, the function F8 is not required by 
any of the operations performed by the computer pro- 
gram P. Therefore, the code section 216 that contains 
the Instructions 'to perform function F8 is never ac- 
cessed: ' 

MONITORED EXECUTION OF PROGRAM 

According to an embodiment of the present inven- 
tion, the computer program P is executed on computer 
system 100. Specifically, a user enters user input to 
cause computer system'100 to begin execution of the 
computer program P.' According to the assumptions stat- 
- ed* above, the program initialization operation OP1 will 
' be' executed in response to the user input. * ' 



Referring to Figure 3;< it illustrates a timeline 300 of 
the events which occur during the time period in which 
processor 102 is executing the computer program P. 
Time TO represents the time at which the user enters 
s the input to invoke the computer program P. In response 
to the user input, processor 102 performs operation 
OP1, During the performance of OP1, processor 102 
performs functions F3, F2 and F6 by reading and exe- 
cutinginstructions contained in code sections 206, 204 
10 and 21 2, as indicated by lines 302, 304and 306, respec- 
tively. - ■ " - . : ' . r 

Figure 3 represents accesses to each of code sec- 
tions 206, 204 and 21 2 by a single line. It should be un- 
derstood, however, that the performance of a single 
is function may require hundreds of accesses to a partic- 
ular code section. In general, the first access of a code 
section will cause the code block containing the code 
section to be loaded into fast storage. Subsequent ac- 
cesses to the same code section during the same dis- 
20 crete high level operation will occur with such rapidity 
that the code block containing the code section will not 
be transferred out of fast memory while the high level 
operation is being performed; Therefore, the number of 
times that a particular code section is accessed during 
2S the performance of a discrete high level operation has 
! " little effect on the minimum size of the loaded portion 
and the number of block transfers that have to be per- 
i f formed during the execution of the high level operation. 
J ' During the execution of the computer program P, 
30 computer system 100 detects and records which code 
sections of instruction data image 200 are accessed by 
processor 1 02 and the time at which they are accessed. 
This data is referred to hereafter as the "access record". 
Computer system 100 may store the access record on 
35 any storage device, such as disk 107 or memory 104. 
Optionally, computer system 100 also detects and 
records when input is entered by the user ; 1 

The initialization operation OP1 is completed when 
processor 1 02 completes the performance of function 
40 F6. Upon the completion of operation OP1, computer 
system 1 00 suspends execution of the computer pro- 
' gram P until the user indicates which operation to per- 
form next. While execution of the computer program P 
is suspended, processor 102 may be performing other 
4s operations related to other computer programs and/or 
repeatedly polling input devices to detect user input. 

For the purposes of explanation, it shall' be as- 
sumed that at time T1 the user enters input to invoke 
operation OP2. Computer system 100 detects and 
so records the time associated with this user input. Proc- 
essor 102 performs operation OP2 in response to the 
detected user input? During the performance of opera- 
tion OP2, processor 102 reads arid executes instruc- 
v tiohs contained in code section 208 to perform function 
55 . F4, and reads and executes instructions contained in 
code section 204 to perform function F2. Computer sys- 
- tern 100 detects* and records in the access record the 
" time when each of these code sections is accessed Op- 
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eration OP2 is completed when processor /1 02 com- 
pletes the performance of function F2. Upon the com- 
pletion of operation OP2, computer system waits for us- 
er input to determine what operation to perform next. 

At time T2, the user enters, input to terminate the 
computer program P. Computersystem 100 detects and 
records the time of this user input. In response to the 
user input,;processor 102 performs operation OP3. Dur- 
ing the performance of operation; OP3, processor 1 02 
reads and executes instructions from code section 204 
to perform function F2, reads and executes instructions 
from code section 210 to perform function F5, reads and 
executes instructions from code section 202 to perform 
function F1 and reads and executes instructions from 
code section 21 4 to perform function F7. Computer sys- 
tem 1 00 .detects.and records in the access jecord the 
timing of each of these code section accesses. At time 

. T3, execution of the computer program P associated 

-with instruction data image 200 ends.-, 
- ■ • ... 

ACCESS DETECTION ■ f f ■ 

During the monitored; program execution; process 
described above, computer system 100 detects and 
records whery specific code, sections, are . accessed. 
Many, techniques may be used. to perform this access 
detection. -According to one embodiment of the inven- 
tion, a sequence -of instructions is placed in-each code 
section. The sequence of instructions causes processor 
1 02 to record data that identifies, the code section in 
which, the sequence resides and the current time. For 
example, a sequence of instructions may be embedded 
, in code section 202 which, when executed, causes proc- 
essor 1 02 to record data^hat identifies function F1 and 
the .current time. Similarly, a-sequence of instructions 
may be embedded in code section 204 which, when ex- 
ecuted, causes , processor ,1p2 to record data that iden- 
tifies function F2 and the current. time. ;. 

In an alternative embodiment, computer system 
100 is configured to execute a detection program simul- 
taneous witrvthe execution of the computer program P. 
The detection program causes computer system. 100 to 
detect and record when processor-102 is accessing the 
: various code sections of computer program P. I n.yet an- 
: other embodiment,-^ monitoring hardware js added to 
computer system 100 to detect and record calls made 
by processor 1 02 during the execution of the computer 
..program p. ^ , . - . ■:,.*; 

ACCESS MATRIX CONSTRUCTION 

When the, execution of the computer program P 
ends, computer system 100 constructs, within memory 
1 04 an access matrix based on the information that was 
.stored during the execution of the computer program R 
~* ' Initially, computer system 100 divides the time pe- 
riod between TO and T3 (the "execution period") into 
time intervals. Various methods may be used to deter- 



mine the size, number, and boundaries of the time in- 
tervals into which the execution period is divided. For 
example, the execution period may be divided into time 
. intervals having a predetermined duration. Alternatively, 
5, the.execution period may be divided up into a predeter- 
mined number of time intervals of equal duration. The 
execution period may also be divided up into time inter- 
vals of variable duration based on factors such as the 
density.and distribution of function calls and/or ,the tim- 
10 jng of user input/during, the execution period: The 
present invention is not limited to any particular tech- 
nique for dividing the execution, period, into intervals. 
However, the selected time intervals are preferably 
short enough.to ensure a low average paging rate within 
*5.. each; time interval,^ . . 

. In . the present .example, -computer, system 100 di- 
vides the.execution period into time intervals based on 
the timing of user input durjng the execution period. Spe- 
cifically, the execution period, is divided intotthree time 
20 intervals: INT1 , JIMJ2 and INT3. Interval I NT1. covers the 
-time between the input which invoked the program P 
.and the input-that invoked operation OP2. Interval J NT2 
covers the time ^between, the input which invoked, oper- 
ation OP2 and the input which invoked operation OP 3. 
25 Interval INT3 covers the time between the input which 
j.. invoked operation OP3.and the termination of theicom- 
puter program R - \\ ■ • 

. When the various time intervals have been deter- 
. ■ ., mined, computer system 1 00 constructs a matrix where 
30 .each row corresponds to a code section in: instruction 
, data image ,200 and each column corresponds to one 
of the time intervals, The matrix may be constructed, for 
. example, in memory 104. Figure 4 illustrates an access 
matrix 400 that has three columns 402, 404 and 4p6 that 
35 correspond to * jme intervals I NJ1 , I NT2 and I NT3, re- 
spectively, and eight rows 408, ,410, 412; 414, 416, 41 8, 
420 and 422 that correspond to code sections 202, 204, 
206, 208, 210,. 21 2, 214 and 21 6 ; respectively. : 

Computer system 100 fill&in the rnatrix 400 with val- 
40 ues based on the access record that was created during 
the execution, period.- According to-one embodiment, 
each, cell in access matrix 400 stores one bit. For each 
cell, the brtjsset-.it and onlyjf the code section that cor- 
responds to the row in which the cell resides was ac- 
45 xessed during thetime interval that corresponds to the 
column in which, the cell resides. For example, cell 424 
it resides in the row 408 that corresponds to code section 
202, and in the column 402 that corresponds, to interval 
INT1 . Consequently, the bit stored in cell 424 is set if 
50 and only if code section 202 was accessed during inter- 
val INT1 . In the example given above, code section 202 
. was,, not accessed during interval INT1, so cell 424 
stores a "0". • ( . . - 

When-computer system 1 00 has completely filled in 
55 access matrix 400 based on the access data stored.dur- 
ing the execution period,. each row will store a binary 
array associated with a, particular code section.. For ex- 
ample, row 408, which corresponds to code section 202, 
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stores the binary array "001". Computer system 100 
then determines ah order tor the various code sections 
based on the binary array associated with the code sec- 
tions. . . 

ORDER DETERMINATION 

Various techniques may be used to determine an 
order for the code sections based on the binary arrays 
that' correspond to the code sections. For example, a 
number may be assigned to each code section based 
on the Value of the biliary number represented by the 
binary 'array associated With the code section. Applying 
this ordering technique to the present example; code 
section 202 would be assigned the number n i ^because 
its binary array u 0d1 T is a binary representation of "1 \ 
Code section 204 would be assigned the number "7" 
which is represented by the binary array "111 " that cor- 
responds to code section 204. Code sections 206, 208, 
210, 212, 214 and 216 would be assigned the numbers 
4, 2, 1 , 4, 1 arid 6 1 respectively? 

" Once each code section has been assigned a 
^number, computer system 100 deterrinihes the order for 
the code sections based on the numerical order of the 
numbers assigned to the code sections. Thus, code sec- 
tion 204; Which has been assigned the number 7", 
would be followed by code sections 206 and 2 T2, which 
have been assigned the number u 4'. r Code sections 206 
and 212 Would be followed by code section 208, which 
has been assigned the number n 2 D ,' and then by code 
sections 202, 210 and 21 4 which have all been assigned 
the number °1 Code section 216, which has been as- 
signed the number' "O", would be the last in the order. 

In the present example, numerous' code sections 
have identical binary arrays. For example, code sec- 
tions 202, 210 arid 21 4 are all associated with the binary 
array b 001 n . Consequently, something other than the bi- 
nary array must be used to determine how these code 
sections are ordered with respect to each other. Accord- 
ing to one embodiment, the order. among code sections 
with identical binary arrays may simply be random. Ac- 
cording to an alternative embodiment, code sections 
with identical binary arrays may be ordered based on 
the order in which they are accessed during one or more 
time intervals: For example, cbcle sections 202, 21 0 and 
214 were all accessed during time interval INT3. Of 
these three oode sections, code section 210 was ac- 
cessed first, code section 202 was accessed second 
and code section 214 was accessed third. This access 
order may therefore be reflected in the code section or- 

a ' er * " ' . 

Figure 5 tl lust rates an instruction data image 500 
that Has been constructed by reordering the code sec- 
tions of instruction data image 200 according to the or- 
der determined by the process described above. It 
should be noted that there is a stronger correlation be- 
tween the location of the code sections in instruction da- 
ta image 500 and the operations that use the code sec- 



' tions.than there is between the location of the code sec- 
tions in instruction data image 200 and the operations 
that use the code sections. This stronger correlation re- 
sults in a significant performance increase when the 

5 computer program P represented by the instruction data 
image is executed in a virtual memory system. 

For example, assume that each of the code sec- 
tions 202, 204, 206, 208, 210, 212, 214 and 216 has a 
size of 1K bytes. Assume also that the computer pro- 

10 gram P* is executed oh a virtual memory system that per- 
forms transfers between the slow, and fast portions of 
virtual memory in 4K blocks. Under these conditions, the 
eight code sections would be distributed over two 4K 
blocks. If the code sections 202, 204, 206, 208, 210, 

is 212, 214 and 216 are ordered as shown in instruction 
data image 200, then the first b'lbck (BLOCK1) would 
include code sections 202, 204, 206 and 208, and the 
second block (BLOCK2) would include code sections 
210, 212; 214 and 216. If the code sections 2&2, 204,^ 

20 206, 208, 21 0\ 21 2, 214 and 216 are ordered as shown 
in instruction data image 506, then the first block 
(BLOCKA) would include code sections 204, "206, 212 
and 208, andthe second block (BLOCKB) would include 
code sections 202, 210, 210, 214 and 216^ 

25 Based on the foregoing, if the code sections are or- 
v dered as shown in instruction data image 200, the per- 
formance of operation OP 1 would require the loading of 
two 4K blocks (BLOCK 1 and BLpCK2)/ the perform- 
ance of operation OP2 would require the loading of one 

30 4K block (BLOCK1) and the performance of operation 
OP3 would require the Ibadihg of two 4K blocks 
(BLOCK 1 and BLOC K2). In contrast, if the code sec- 
tions are ordered as shown in instruction data image 
500, only one block (BLOCKA) would have to be loaded 

35 to perform operation OP1,' one block (BLOCKA) would 
have to be loaded to perform operation OP2, and two 
blocks (BLOCKA and BLOCKB) would have to be load- 
ed to perform operation OP3. In this context; a code sec- 
tion is ,, loaded ,, by copying it from the slow storage por- 

40 tion of virtual memory to the fast storage portion of virtual 
memory if it is hot already present in the fast storage 
portion of virtual memory. 

The fact that one less block needs to be loaded dur- 
ing the initialization operation QP1 when the code sec- 

45 tions are ordered as shown in instruction data image 500 
may lead to significant efficiency gains. For example, 
consider the extra operations that a two block initializa- 
tion operation OP1 may require. If the fast portion of vir- 
tual memory is already crowded, then a block of data 

so may^have to be written to the slow storage portion of 
virtual memory to provide room for BLOCK2. Once OP1 
has i been completed, BLOCK2 will just take up' valuable 
space in fast storage until it is deallocated or trie com- 
/ puter program P is terminated. 

55 A simple example has been selected to clearly de- 
scribe the present invention. However, "most computer 
. programs are significantly more complex than the ex- 
emplary computer program P. In practice, many compu- 
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ter programs perform, hundreds of discrete, high-level 
operations and thousands of functions. In such complex 
conditions, even greater efficiency gains may be real- 
ized by ordering code sections according to the present 
invention. For example, the code sections that perform 
a complex operation may be distributed over ten 4K data 
blocks prior to reordering the.code sections. Reordering 
may consolidate the code sections in a single 4K data 
block. Thus, one tenth as many data blocks must be 
loaded into fast storage to perform the operation. 

ORDER DETERMINATION BASED.ON SIMILARITY 
OF BIT PATTERNS 

The ordering technique described above is merely 
.one of many possible, methods for ordering the "code 
sections based on the access record. According to an 
alternate embodiment of the invention, the access ma- 
. c . trjx 400 is constructed .as described above, but the code 
,7 sections are reordered so that the least number of bits 
are changed between "the bit arrays of successive code 
sections. , 

To arrive at such an order, a. first code section is 
selected and placed first in the new code section order. 
The bit array corresponding to the first, code section be- 
comes the. "current bit array". The current bit array is 
compared to the bit arrays of the other code sections to 
determine the bit array with the least degree of deviation 
from the current bit array. In this context, the degree of 
deviation between two binary arrays is determined by 
how many corresponding bit values in the two binary ar- 
rays are different! For example, the three bits in the bi- 
nary array "001 * of code section,202 are Identical to the 
^ three bits of binary array "001 M of code section 210. Con- 
sequently,. the degree of deviation between the two bi- 
. nary arrays is zero. In contrast, only the second bit of 
the binary array "001 0 of code section 202 matches the 
corresponding bit in the binary array "lOO" of code sec- 
tion 206. Thus, the degree of deviation between the bi- 
nary arrays of codes sections 202 and 206 is two. The 
degree of deviation may be derived by counting the 
number of bits set in the exclusive OR of the two bit ar- 
rays. 

Once the bjnary array with the. least degree of de- 
/ viatioh with the current binary array, has been deter- 
*" mined, it becomes the current binary array, and the code 
" section associated with it is placed second in the new 
' order of code sections. The new current, binary array is 
then compared with binary arrays of all of the code sec- 
tions that have not yet been placed in the new code sec- 
tion order. The binary array that has the least degree of 
. deviation from the current binary array becomes the new 
current array, and the code section associated with it is 
placed third in the new code sectiph order. This process 
is repeated until all of the code * sections have* been 
placed into the new code section order. 

Applying this reordering technique to the present 
example, it shall be assumed that code section 204, 



which has the numerically highest binary array, is se- 
lected as the first code section in the new code section 
order. Other criteria may be used to select the first code 
section. For example, the first code section may be ran- 

s domly selected, selected to be the first code section to 
execute at program start-up,_ or selected to be the nu- 
merically lowest binary array. The present invention is 
t not limited to any particular selection. criteria. 
, Having selected code section 204 as the first code 

io t section in the new. code section order, the binary array 
"111° associated with code section 204 becomes the 
current binary array. The current binary array is com- 
pared with the other binary arrays to determine the de- 
gree of deviation between it and each of ( the other binary 

15 arrays. The cpde t section that is associated with the bi- 
nary array 'with the least degree of' deviation from the 
current .binary array is selected as the next array in the 
new code section order. The degree of deviation be- 
tween "111° and all of the other arrays is "two, with the 

20 exception of thet.arrayi "000; associated with code sec- 
tion 216, whose degree of deviation is three. 
, . Only one code section can immediately follow code 
, section 202 in the new code section .order. Therefore, 
.some criteria must be employed td resolve, "ties" be- 

25 tween binary arrays that have equal degrees of devia- 
. tion .One tech n ique to resolve ti es would be to randomly 
. select on e of code sections i n vplved i n th e tie . Ho weve r, 
better results may be achieved by selecting, among the 
code sections involved in the tie, the code section that 

30 was accessed first during the execution period. In the 
present example, code section 206 was the /first code 
section to be accessed Jn the execution period. There- 
fore, code section 206 is selected to be the second code 
section in the new code, section order. 

35 Having selected code section 206 to be the next 
code section in the code section order, the binary array 
!100 D associated with code section 206 becomes the 
current binary array. The current binary array is com- 
pared with the binary, arrays of all of the code sections 

4b that have 'not yet been placed in the new code section 
order to determine the degree of deviation between it 
and the other binary arrays. The code section that is as- 
sociated with the binary array with the least degree of 
deviation from the current binary array is selected as the 

45 next array in the new code section order/ 

. ... . In the present example, the binary array D 100° as- 
sociated with code section 212 is identical to the current 
binary array. Therefore, code section 212 is selected as 
the next code section in the new. code section order. 

50 Consequently, the binary array "1 00" associated with 
code section 212 becomes the current binary array. 

The current binary array "1 00" is compared with the 
binary arrays of all of the, code sections that have not 
yet been placed in the new code section order to deter- 

.55 mine the. degree of deviation between^ it and the other 
binary arrays. The code section that, is associated with 
the binary array with the least degree of deviation from 
the current binary array is selected as the next array in 
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the new code section order. 

* .- In the present example, the binary array D 000° as- 
sociated with code section 216 has the least degree of 
deviation from the current binary array. Therefore, code 
section 216 is' selected as the next code section in the 
new code section order. Consequently, the binary array 
w 000". associated. with code section, 21 6 becomes the 
current binary array. . • . - < :■ . 

- - The current binary array a 000 a is compared with the 
binary arrays of all of the code:sections that have not 
yet been placed in the new code section order to deter- 
mine the degree of deviation between it and the other 
binary arrays. The code section that is associated with 
the binary array with the least degree of deviation from 
■ the current binary array/is selected as the next array in 
the new code section order. 

In the present example, the binary arrays associat- 
ed with code sections 202, 208, 210 and 214 all have 
the same degree of deviation from the current binary ar- 
ray. Of these code sections, code section 208 was the 
first code section,to be accessed during the execution 
.'/period: Therefore, code section 208 is selected as the 
: ; next- code section in the new code section order. Con- 
^ sequently. the binary:array "01 0" associated with code 
section 208 becomes the current binary array. 

The current binary array "01 0" is compared with the 
-binary arrays of a!l of the code sections that have not 
yet been placed in the new code section order to deter- 

• mine the degree of deviation between it and the other ■ 
binary arrays. The code section that is-associated with 
the binary array with the least degree of deviation from 
the current binary array is selected as the next array in - 
the new code section order.* 

In the present example, the binary arrays associat- 
ed with code sections 202, 210 and 214 all have the 
same degree of deviation from the current binary array. 
Of these code sections, code section 210 was the first 
code section to be accessed during the execution peri- 
od. Therefore, code section 21 0 is selected as the next 
code section in the new code section order. Conse- 
quently, the binary array "001" associated with code 
section 210 becomes the current binary array. 

The current binary array "001 tt \s compared with the 
binary arrays of all of the code sections that have not. 
yet been placed in the new code section order to deter- 
mine the degree of deviation between it and the other 
binary arrays. The code section that is associated with 
the binary array with the least degree of deviation from 
the current binary array is selected as the next array in 
■ the new code section order. : 

- i, in the present example, the binary arrays associat- 
ed with code sections 202 and 214 are identical to the 
current binary array Of these code sections, code sec- 
tion 202 was the first code section to be accessed during 
the execution period. Therefore, code section 202 is se- 
lected as the next code section in the new code section 

r ' order. Consequently, the binary array °00 1 ° associated 
with code section 202 becomes the current binary array. ; 



The current binary array °0.01 " is compared with the 
binary arrays of all of the code sections that have not 
yet been placed in the new code section order to deter- 
mine the, degree of deviation between it and the other 
s binary arrays. The code section that is associated with 
the binary array with the least degree of deviation from 
the current binary array is selected as the next array in 
the new code section order. 

At this point, code section 21 4 is the only code sec- 
io tion that has not yet been placed in the new code order. 
Consequently, code section 21 4 is selected as the next 
code section* in the newrcode section order. Having 
placed all of the code sections in the- new code section 
order, the reordering process is-complete. . 
is , Figure 6 illustrates instruction data image 600 for 
computer program P in which the code sections have 
been reordered according to results of the n least-de- 
gree-of -deviation" reordering process described above. 
Similar to the instruction data image 500, the^order of 
20 the code sections in instruction data image 600 has a 
stronger correlation to the high-level operations per- 
formed by corfiputerprogram P than doesjthe order of 
the code sections in the original instruction data image 
■ :•. 200. , : . ' ■ 

25 . Two techniques for ordering code sections based 
on when the code sections are accessed during an ex- 
ecution period have been described in detail above. 
\ However, the described techniques are merely exem- 
plary. Various other techniques may be used. For exam- 
30 pie, the code sections may be ordered to reflect the or- 
der in which the code sections are first accessed during 
the execution period. Applying this technique to the 
present example, the code sections would be reordered 
>in the following sequence: code section 206, code sec- 
35 tion 204; code section 21 2, code.section.208, code sec- 
tion 210, code section 202, code section 214 and finally 
code section 216. Note that this order may be readily 
determined from the access record and does not require 
the construction of an access matrix. 

REORDERING THE INSTRUCTION DATA IMAGE 

r ; .* Once a. new order for the code sections of a com- 
:\ puter program has been determined, a new instruction 
45 data image is constructed in which the code sections 
are rearranged to reflect the new code section order. Ac- 
cording to one embodiment of the invention, the new in- 
struction data image is created based^on a map file. 
Specifically, a map file is created which designates the 
so linkiorder for the object code files that correspond to 
each of functions F1 , F2, F3, F4, F5, F6,F7 and F8. The 
. link order designated for each of the functions is based 
' on the order that has been determined for the code sec- 
" " tions that correspond to the functions. Thus, to construct 
' -SS, the instruction data image illustrated in Figure 6, the 
•■/; map file specifies that the object code-files should be 
:~- linked according to the order F2 ; F3, F6, F8, F4; F5, F1 
-and F7.'This map file is read by a.linker program exe- 
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cutingon processor 102: Based on the map file, the link- 
er program causes processor 102 to link the various ob- 
ject code modules associated with functions F1 , F2, F3, 
F4, F5, F6, F7 and F8 to construct the instruction data 
image 600 shown in Figure 6. 

Other techniques may be. used to construct instruc- 
tion data images in which the code sections are reor- 
dered based on the a code section order determined ac- 
cording to the present invention. For, example, a com- 
piler may be constructed to read a compiler map file. 
The compiler map file would designate the order in 
which object code is generated for functions or portions 
of functions. Alternatively, a mechanism may. be con- 
structed which simply rearranges sections of an existing 
instruction' dataimage to form a new instruction data im- 
age^ For example, processor .1 02; can be programmed 
to extract code sections from instruction data image 200 
and store the code sections in a new order to produce 
-instruction data image 600. This rearrangementprocess 
may require some of the address references within the 
various code sections to be modified to reflect the new . 
■ locatioaof the code which they reference.. - : 

* In.the preceding discussion,- reordering techniques 
have been described with specific reference to code 
sections. However, the present invention is not limited 
to re-ordering code sections. Specifically, rathenthan re- 
ordering *the code of a program, the* techniques de- 
scribed above may be used to re-order data that is ac- 
cessed during the execution of a compiiter-program. For 
< example, a database program may access some sec- 
tions of data at different times and frequencies than oth- ■ 
er sections of data* These data accesses are more ef- . 
ficient when sections of data are stored in the same or- 
. der that they are accessed. To apply^the. re-ordering 
techniques to data, the database program would be ex- 
ecuted during an execution period.. Data accesses 
made by the database program during the execution pe- 
riod would be detected and recorded. The recorded ac- 
cess information would be used to re-order the data ac- 
cording to the re-ordering techniques described above. 

Programmed "objects" are sets of related functions 
and data. Just as the above-described techniques can 
be used to re-order sections that are all-code or all<iata, 
rthe techniques can be used to re-order objects, which" 
include both code and data ^ : r- 

• Two distinct and significant benefits have been ob- 
tained through the application of the .reordering tech- 
niques described herein. -First the code portions for rou- 
tines that correspond to the same operation are more 
tightly clustered/Because the code for a given operation 
- is distributed over fewer code, sect ions; the. average 
. amount of code that must be resident in fast memory- 
during the performance any given operation is reduced. 
Consequently, the same operation may be performed 
while using a smaller amount of fast. memory. This al- 
lows systems with less fast memory to. execute re-or-. 
dered code at the same level of efficiency as systems 
with more fast memory can execute code that has not 



been re-ordered. In addition, more fast memory be- 
comes available for other concurrently-executing oper- 
ations. 

The second benefit is that the average number of 
s page faults that occur when loading the code sections 
-• required to. perform an operation is significantly re- 
duced. The number of page faults is reduced. because 
the code sections are alignedJn the order that they are 
used. Thus, code sections that are used together and 
io loaded together are stored together. . 

While specific embodiments of' the present inven- 
tion have been described, various modifications and 
substitutions will. become apparent by this disclosure. 
: Such modifications, and substitutions are within the 
is scope of the present invention, and are intended to be 
covered by the following claims; ..*; • ,* _<i 
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Claims 



1;.. A method executable in a computer system for or- 
dering code sections , of .a computer;, program, 
. r , wherein the. computer program includes a plurality 
vv<* of code sections, the method comprising the steps 

25 * of;" . V < "y. 



executing the computer program during.an ex- 
ecution period;-/* .<-.-.„ . :<■; 
detecting. when each of- said plurality of code 
\ sections is used during said .execution period; 
■. and - v ; •-<?■.', - 
. ordering said code sections based on when 
each of said code sections is used during said 
: execution period. 
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2...; The method of Claim 1 further comprising the steps 

• of: , _ • : . ■ v y - 

' _ , dividing said execution period into a plurality of 
time intervals; and 

ordering said code sections based on the time 
intervals. of said - plurality of time intervals in 
which each of said code sections was used. 



45 .3. The method of Claim 1 wherein: 



each of said code sections implements a func- 
tion; and 1 

said step of detecting when each of said plural- 
ity of code sections is used comprises the step 
of detecting when a call is made to said function 
implemented by ; said code section. 



so 



55 



The method, of Claim wherein said step of ordering 
said code sections comprises: . .v 

a) generating .a plurality of data arrays for said 
plurality of code sections by performing the f ol- 
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lowing steps for each code section of said plu- 
rality of code sections 

a1 ) generating a dataarray, wherein each 
cell in said data array corresponds to a time 
interval of said plurality of time intervals; 
and . _ .. - . ; 

a2) storing in each cell in said data array a 
value that is based on whether the code 
., n section associated with said data array 
was used during the time interval that cor- 
responds to said cell; - 

b) ordering said code sect ions . based on said 
/ , plurality of data, arrays. 

S. The method of Claim 4 wherein said step of b) or- 
dering said code sections based on said plurality of 
,data arrays comprises the steps of:. 

determining : a numerical value for each code 
section, wherein said numerical value for each 
.[[ code section is a, number. represented by the 
.* . . values stored in the data array that corresponds 
to said code section; and 
arranging said plurality of code sections in nu- 
merical order based on said numerical value 
... ., , ..determined for- each code section. 

' 6. The method of Claim 4 wherein said step of b) or- 
dering said code sections based on said plurality of 
data arrays comprises the steps of: 

b1) selecting a selected code section of said 
plurality of code sections; 
b2) assigning said selected code section a par- 
. ... ; ticular position in a new code section order; 

b3) establishing the data array that corre- 
, sponds to said selected code section as a cur- 
rent data array; 

b4) performing a comparison between the cur- 
rent data array and data arrays that correspond 
to code sections which have not yet been as- 
signed a position in said new, code section orz 

der;' ■ / • ..\. ■ - T 

b5) selecting, based on said comparison, a next 

code section from said code sections which 
have not yet been assigned a position in said 
new code section order; . - > . . 
b6) assigning said next code section to a next 
position in said new code section order; 
b7) establishing.the data array associated with 
said next code section as said current data ar- 
. ray; and 

, b8) repeating steps b4) through b7) until each 
code section of said plurality of code sections 
, . , - has been assigned a position in said new code 
section order. 



7. The method of Claim 6 wherein said step of select- 
ing, based on said comparison, a next code section 
from said code sections which have not yet been 
assigned a position in said new code section order 
5 comprises the.step of selecting as said next code 
sectipn .the code section that corresponds to the da- 
ta array that is a least degree of deviation from said 
current data array. , 

10 8. The method of Claim 2 wherein said step of dividing 
said execution period into time intervals comprises 
the steps of: , 

detecting, user input cluring said execution pe- 
ts hod, and . ,.. 

dividing said execution period into time inter- 
vals based on when said user input occurs with- 
in said execution period. 

' ' A ' 
20 9. The method of Claim J .further comprising the step 
of. , . • . . . . .. . • " , 

if two or more data arrays have said least degree of 
deviation from said current data array, then select- 
ing as said next code section the code section that 



25 



30 



i) corresponds to a data array of said two or 
more data arrays; and 

ii) was accessed during said execution period 
before any other of said code sections that cor- 
respond to one of said two or more data arrays. 

10. The method of Claim, 6 wherein each cell in said 
plurality of data arrays hold a single bit value. 



35 . 11. The method of Claim 10 wherein said step of per- 
forming a comparison between the current data ar- 
ray and data arrays that correspond to code sec- 
tions which have not yet been assigned a position 
in said new code section order comprises the step 

40 : of performing an exclusive or f unction between a bit 
pattern stored in the current data array and bit pat- 
terns stored in data arrays that correspond to code 
sections which have not yet been assigned a posi- 
. , tion in said new code section order 

12. A computer system comprising: 

. ..,a memory storing a plurality of code sections of 
v - - a computer program; , . 

so a processor coupled to said memory, said proc- 

essor accessing said plurality of code sections 
during an execution period to execute said 
computer program during said execution peri- 
od, said processor storing in said memory an 
55 access record, that indicates when specific 

code sections of said plurality of code sections 
', : \" , . were accessed by said processor during said 
execution period; and 
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a mechanism configured to order said plurality 
of code sections based on said access record. 

13. The computer system of Claim 12 wherein said 
mechanism includes said processor configured to 
execute a sequence of instructions stored in said 
memory, said sequence of instructions including in- 
structions which, when executed by said processor, 
cause said processor to read said access record 
and generate a new code section order for said plu- 
rality of code sections based on said access record. 

14. The computer system of Claim 12 wherein said se- 
quence of instructions includes instructions which, 
when executed by said processor, cause said proc- 
essor to perform the steps of: 

1 i dividing said execution period into a plurality of 
L* .*" time intervals; arid J 

ordering said code sections based on the time 
1 ' intervals of said plurality of time intervals in 
which each of said code sections was accessed 
by said processor " ' ' 1 ' , l ", 

15. The computer system of Claim 14 wherein said se- 
quence of instructions includes instructions which, 
when executed by said processor, cause said proc- 
essor to perform the steps of: 

a) generating a plurality of data arrays for said 
plurality of code sections by performing the fol- 
lowing steps for each code section of said plu- 
rality of code sections 

a1) generating a data array, wherein each 
* 1 cell in said data array corresponds to a time 
interval of said plurality of time intervals; 
and 

a2) storing in each cell in said data array a 
' value that is based on whether the code 
section associated with said data array 
was used during thetime interval that cor- 
responds to said cell; 

b) orderirigsaid code sections based on said 
plurality of data arrays. 

16. The computer system of Claim 15 wherein said step 
of b) ordering said code sections based on said plu- 
rality of data arrays comprises the steps of: 

determining a numerical value for each code 
section, wherein said numerical value for each 
code section is a number represented by the 
Values stored in the data array that corresponds 
to said code section; and 
arranging said plurality of code sections in nu- 
mericaf order based on said numerical value 



determined for each code section. 

17. The computer system of Claim 1 5 wherein said step 
of b) ordering said code sections based on said plu- 
s rality of data arrays comprises the steps of: 

b1) selecting a selected code section of said 
plurality of code sections; 4 
b2) assigning said selected code section a par- 
10 ticular position in a new code section order; 

b3) establishing the data array that corre- 
' sponds to' said selected code section as a cur- 
rent data array; 

b4) performing a comparison between the cur- 
is • ' rent data array and data arrays that correspond 
to code sections- which have not yet been as- 
signed a position in said new code section or- 
*■■■' ■ de'r;' " ' ' ■ ' r ' ■ 

• - b5) selecting, based on said compari son, an ext 
code section from said code sections which 
have not yet been assigned a position in said 
hew code' section order;' ■ 
* ' y b6) assigning said next code' section to a next 

r - position in said new code section order; 
' ■■' b7) establishing the data array associated with 
said next code section as* said current data ar- 
- ray; and ; ,; : ■•' '■ * * 

b8) repeating steps b4) through b7) until each 
code section of said plurality of code sections 
has been assigned a position in said new code 
section order. r : * : 



18. The computer system of Claim 12 wherein said 
mechanism orders said plurality of code sections 
according to the' order in' which said code sections 
were first accessed during said execution period. 

19. The computer system of Claim 12 wherein said 
memory includes a nonvolatile storage medium and 
a volatile storage medium, said nonvolatile storage 
medium being relatively slower than said volatile 
storage medium. 

20. The computer system of Claim 19 wherein at least 
: one portion of said nonvolatile storage medium and 

at least one portion of said volatile storage medium 
are used ' in said computer 'system to implement a 
' virtual storage space: 
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50 21. A computer program product comprising: 

a computer usable medium having computer 
readable code 1 embodied therein for ordering 
1 code sections of a v target computer program, 
55 wherein the target computer program includes 

a plurality of code sections, the" computer pro- 
grarh'product comprising: 
compute r'readable program code devices con- 
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figured to cause a computer to detect when 
each of said plurality of code sections is used 
during an execution period, the execution peri- 
od being a time period during which the target 
computer program is executed; and 
computer readable program code devices con- 
f > . . figured to cause a computer to order said code 
sections based on when each of said code sec- 
. tions is used during said execution period. 

22. The computer program product of Claim 21 further 
comprising: 

computer readable program code devices con- 
figured to cause a computer to divide said ex- 
ecution period. into a pluraliry of time intervals; 

and v" ; ■ 

, computer readable program code devices con- 
• figured to cause a computer to order said code 
sections based on the time intervals of said plu- 
raliry of timejntervals in which each of said 
code sections was used. 

23. The computer program product of Claim 21 where- 
in: 

■ . — ' >. each of said code sections implements a func- 
tion- and. ;- 

said computer.readable program code devices 
configured to cause a computer to detect when 
, each of said plurality of code sections is used 
comprises computer readable program code 
devices configured to cause a computer to de- 
tect when a call is made to said function imple- 
> mented by said code section. 

24. The computer program product of Claim 22 wherein 
said computer readable program code devices con- 
figured to cause a computer to order said code sec- 
tions comprise: ' 

a) computer readable program code devices 
configured to cause. a. computer to generate a 
plurality of data arrays for said plurality of code 
*• , sections by causing the computer to'perform 
the following steps for each code section of said 
plurality of code sections 

a1 ) generating a data array, wherein each 
< , cell in said data array corresponds to a time 
* , >< .; . . . interval of said plurality of. time intervals: 

- ■ and ■ - * ■ ■ 

a2) storing'in each cell in said data array a 
value that is based on. whether the code 
r; «r section associated with said data array 
. was* used during the time interval that cor- 
responds to said cell; 
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b) . computer readable program code devices 
configured to cause a computer to order said 
code sections based -on said plurality of data 
- arrays. 

25. The computer program product of Claim 24 wherein 
said computer readable program code devices con- 
figured to cause, a computer to order said code sec- 
tions based on said plurality of data arrays compris- 
es: 

. . computer readable program code devices con- 
y-„- figured to cause a computer to determine a nu- 
merical value for each -code section, wherein 
said numerical value for each code section is a 
number represented by:the values stored in the 
data array that corresponds to said code sec- 
tion; and 

computer readable program code devices con- 
20 figured to cause a computer to arrange said plu- 

: rality of code sections in numerical order based 
on said numerical value determined for each 
code section, • 

25 26. The computer program product of Claim 24.wherein 
^ said computer readable program code devices con- 
r t , - - figured to cause a computer to order said code sec- 
tions based on said plurality of data arrays compris- 
. * es computer readable program code devices con- 
figured to cause a computer to perform the steps of: 

D 1) selecting a selected code section of said 
. plurality of code sections; 
b2) assigning said selected code section a par- 
ticular position in a new code section order; 
b3) establishing the data array that corre- 
sponds to said selected code section as a cur- 
rent data array; 

b4) performing a comparison between the cur- 
rent data array and data arrays that correspond 
to code sections which have not yet been as- 
signed a position in said new code section or- 
. der; .'• ... . . ' •• ■ - 
b5) selecting, basedon said comparison, a next 
code section from: said code sections which 
have not yet been assigned a position in said 
new code section order; 
: b6) assigning said next code section to a next 
~y> : position in said new code sect ion- order; 

. b7) establishing the data array associated with 
^ . said next code section as said current data ar- 
ray: and ' ■' 

b8) repeating steps b4) through b7) until each 
code section of said pluraliry of code sections 
has been assigned a position in said new code 
section order. 

27. The computer program product of Claim 26 wherein 
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said computer readable program code devices con- 
figured to cause a computer to select, based on said 
■ comparison, a next code section from said code 
sections which have not yet been assigned a posi- 
tion in said new code section order comprises com- s 
puter readable program code devices configured to 
cause a computer to select as said next code sec- 
tion the code-section that corresponds to the data 
array that a least degree of deviation from said cur- 
rent data array. 10 

28.. The computer program product of Claim 22 wherein 
said computer readable program code devices con- 
figured to cause a computer to divide said execution 
period into time intervals comprises computer read- .-is 
able program code devices configured to cause a •* 
computer to perform the steps of: ; 

c v.. . detecting user input during said execution pe- 
. z .. . «• riod, and • ■ ^ - ; > • 

I dividing said execution period into time inter- 
. . ~ ■;; vals based on when said user input occurs with- 
in said execution periods 

29. The computer program product. of Claim 27 further 
, .. comprising computer readable program code devic- 
es configured to cause a computer to perform the 
steps of: * :~ - ■ 
if two or more data arrays have said least degree of 
deviation from said current data array, then select- 
ing as said next code section the code section that 

i) corresponds to a data array, of said two or 
. more data arrays; and - 
. ii) was accessed during said execution period 
. ; 3 t before any other of said code: section st hat cor- 
v respond to one of said two or more data arrays. 

30. The.computer program product of :Claim 26 wherein 
each cell in said plurality of data arrays hold a single 
bit value. 1 - 

31. The computer program product of Claim 30 wherein 
said computer readable program code devices con- 

. .figured to cause a computer to perform a compari- 
- son between the current data array. and data arrays 
that corresponclto code sections which have not yet 
• -\ been assigned a position in said new code section 
*. r order comprises. computer readable program code 
..devices configured to cause a computer to perform 
' an . exclusive OR function ^between a bit pattern 
stored in the current data array and bit patterns 
„ ; stored in data arrays that correspond to code sec- . 
7 tions which have, not yet been assigned a position 

in said new code section order. ; l< y 55 

32. A method executable on a computer system for or- 
dering data accessed by a computer program, 
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wherein the data includes a plurality of data sec- 
tions, the method comprising the steps of: 

executing the computer program during an ex- 
ecution period; . 

detecting when each of said plurality of data 
- sections is accessed by said computer program 
^ * * during said execution -period; and 

ordering' said data sections based on when 
each of said data sections is accessed during 
said execution period. J 

33. The method of Claim 32 further comprising the 
■' steps of: .- -i • : * - "- { '. 

1 : '* "dividing said execution period into a plurality of 
time intervals; and 
* ordering said data sections based on the time 
- intervals * of said- plurality' oMime ^intervals in 
■ : ■ which each of said data sections was accessed 
; * by said computer program. 

34. The method of Claim 32 wherein said step of order- 
ing said data sections comprises: ■ : *v.V 

a) generating a plurality of data arrays for said 
. - x plurality of data-sections by performing- the fol- 
lowing steps for each data section of said plu- 
>• *'■. *rality of data -sections 

a1 ) generating a data array, wherein each 
- cell in said data array corresponds to atime 
interval of said plurality of time intervals: 
' \ and . ; ; :- ■ " . — v 

a2) storing in each cell in . said data array a 
value that is based on whether the data 
' section associated with said 'data array 
was . accessed by said computer program 
"\ during the time interval that corresponds to 
said cell; 

' ■» b) ordering said data' sections based on said 
f plurality of data arrays. ' 

35. The. method of Claim 34 wherein said step of b) or- 
. ; dering said data sections based on said plurality of 

data arrays comprises the steps of: 

determining a numerical value for each data 
section,- wherein said numerical value for each 
: J \ - data section is, a number represented by the 
values stored in the data array that corresponds 
v . -;to said data section; and , 

arranging said plurality of data sections in nu- 
merical order, based on -said numerical value 
determined for each data section. 

36. The method of Claim 34 wherein said step of b) or- 
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dering said data sections based on said plurality of 
data arrays comprises the steps of: 

b1 ) selecting a selected data section of said 
plurality of data sections; 5 
b2) assigning said selected data section a par- 
ticular position in a new data section order; 
b3) establishing the data array that corre- 
sponds to said selected data section as a cur- 
rent data array; . 10 
b4) performing a comparison between the cur- ' 
rent data array and data arrays that correspond 
to data sections which have not yet been as- 
siqned a position in said new data section or- 
der; : 15 
b5) selecting, based on said comparison, a next 
data section from said data sections which 
have not yet been assigned a position in said 
new data section order; 

b6) assigning said next data section to a next 20 
position in said new data section order; " '\ 
b7) establishing the data array associated with 
said next data section as said current data ar- 
ray; and - 1 y , 
b8) repeating steps b4) through b7) until each 25 
data section of said plurality of data sections 
has been assigned a position in said new data , 
section order. 
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